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Abstract 

We study new physics effects on the couphngs of weak gauge bosons with the lightest CP-even 
Higgs boson (/i), hZZ, and the tri-linear coupling of the lightest Higgs boson, hhh, at the one 
loop order, as predicted by the two Higgs doublet model. Those renormalized coupling constants 
can deviate from the Standard Model (SM) predictions due to two distinct origins; the tree level 
mixing effect of Higgs bosons and the quantum effect of additional particles in loop diagrams. The 
latter can be enhanced in the renormalized hhh coupling constant when the additional particles 
show the non-decoupling property. Therefore, even in the case where the hZZ coupling is close to 
the SM value, deviation in the hhh coupling from the SM value can become as large as plus 100 
percent, while that in the hZZ coupling is at most minus 1 percent level. Such large quantum 
effect on the Higgs tri-linear coupling is distinguishable from the tree level mixing effect, and is 
expected to be detectable at a future linear collider. 
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I. INTRODUCTION 



In the standard picture of elementary particle physics, the electroweak gauge symmetry is 
spontaneously broken by introducing an iso-doublet scalar field, the Higgs field. Its neutral 
component receives the vacuum expectation value. Consequently, the gauge bosons and the 
matter fields obtain their masses through the couplings with the Higgs scalar field. 

Identification of the Higgs boson is one of the most important goals of high energy col- 
lider experiments. The fit by LEP Electroweak Working Group favors a relatively light 
Higgs boson with its mass below 251 GeV, assuming the Standard Model (SM)^|. The 
search for the Higgs bosons is being carried at Fermilab Tevatron and will be continued 
at CERN Large Hadron Collider (LHC). There the SM Higgs boson is expected to be dis- 
covered as long as its mass is less than 1 TeV. In order to verify the mechanism of mass 
generation, the Higgs boson couplings with gauge bosons as well as fermions have to be 
determined with sufficient accuracy. Moreover, precise determination of the self-coupling 
constant of the Higgs boson is essential to determine the structure of the Higgs potential. 
An electron-positron (e-e+) linear collider (LC), such as GLcQ, TESLaQ or NLCy and 
its photon-photon (7-7) collider option, can provide an opportunity for the precise measure- 
ment of the Higgs boson couplings. At LC's, the Higgs boson (h) is produced mainly via the 
Higgsstrahlung process e^e^ Zh for relatively low energies and also via the fusion pro- 
cess e'^e~ W^*W''*vi' — s> hvv for higher energies jS]. In both production mechanisms, the 
Higgs boson is produced through the coupling with weak gauge bosons. The cross sections 
are expected to be measured at a percent level or better unless the Higgs boson is relatively 
heavy. The Higgs boson couplings with heavy quarks (except the top quark) and the tau 
lepton can be tested by measuring the decay branching ratios of the Higgs boson. Further- 



BflflSliD, n, 12, 12, 14, i3 



and the 



more, the tri-linear coupling of the Higgs boson hhh\ 
top- Yukawa coupling hti can be determined by measuring the cross section of double Higgs 
production processes jiol. 17, 18| e^e~ — >■ Zhh as well as e^e~ W^*W~*vi' hhvv and 
the top-assocated Higgs production processQ e^e- ^ hti, respectively. The option of 
the LC can also be useful for the Higgs self-coupling measurement |20l| . 

Studying the Higgs sector is not only useful for the confirmation of the breaking mech- 
anism of the electroweak gauge symmetry, but also provides a sensitive window for new 
physics beyond the SM. In fact, in many models of new physics an extended Higgs sector 
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appears as the low energy effective theory, which has discriminative phenomenological prop- 
erties. One popular example is known to be the minimal supersymmetric standard model 
(MSSM)|2^, in which the Higgs sector is a two Higgs doublet model (THDM). Some models 
of the dynamical breaking of the electroweak symmetry also induce more than one Higgs 



22|. 



here are other motivations to introduce 



23l | , top-bottom mass hierarchy 2J] , and 



doublets in their low energy effective theories 
extra Higgs fields, such as electroweak baryogenesis 
neutrino mass problem [2^. 

A common feature of extended Higgs sectors is the existence of additional scalar bosons, 
such as charged Higgs bosons and CP-odd Higgs boson(s). After the discovery of the lightest 
Higgs boson, direct search of these extra scalar particles would become important to distin- 
guish new physics models from the SM. Even if the extra Higgs bosons are not found, we can 
still obtain insight by looking for indirect effects of the extra Higgs boson from the precise 
determination of the lightest Higgs boson properties|2^. For example, the mass, width, 
production cross sections and decay branching ratios of the lightest Higgs boson should be 
thoroughly measured to test whether or not these data are consistent with the SM. The 
existence of extra Higgs bosons can affect the observables associated with the lightest Higgs 
boson through both the tree level mixing effect and the quantum loop effect. In this way, 
we might find clues to new physics before finding the extra Higgs bosons from the direct 
search experiments. 

In this paper, we evaluate the Higgs coupling with the gauge boson hZZ and the Higgs 
self-coupling hhh at one loop level in the THDM, in order to study the impact of the extra 
Higgs bosons on the coupling associated with the lightest Higgs boson ih). In Refs. jl^ 



IJ], the one loop contributions of additional Higgs bosons and heavy quarks to the hhh 



coupling are discussed in the limit where only h is responsible for the electroweak symmetry 
breaking (in the SM-like limit). The calculation has been done both in the effective potential 
method and in the diagrammatic method, but details of the calculation were not shown. 
In the present paper, we will show the details of our calculation, in which the on-shell 
.„o.n,:,.a.io„;c;..e0. adopted, in addiUon , new particle effects on the form factors 
of the hZZ coupling are also evaluated. Furthermore, we also extend our discussion in 
Refs. Q,Q for the case of the SM-like limit to more generic cases. 

In the THDM, masses of the heavy Higgs bosons can come from two kinds of contribu- 
tions: the vacuum expectation value v (~ 246 GeV) and the gauge invariant mass term. 
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When the heavy Higgs boson mass is predominantly generated by v, contributions in powers 
of the mass of the loop particles can appear in the one loop effect couplings of hZZ and hhh. 
They are quadratic for the hZZ coupling and quartic for the hhh coupling 2; • In this 
case, relatively large quantum correction is expected in the hhh vertex, especially when the 
particle in the loop is heavy. Although similar non-decoupling loop effects can also appear in 



the THDM 



w+w- 



3l| and those 



28| in the processes of — > 
with the coupling W^H^V {V = Z,'~f)[3T\, the quartic power contribution of the mass is a 
unique feature of the hhh coupling. These observables can receive large quantum corrections 
due to the non-decoupling effects. On the contrary, when the heavy Higgs bosons obtain 
their masses mainly from the other source, such power-like contribution disappears and the 
one loop effects vanish in the large mass limit. The Higgs sector of the MSSM belongs to 
this case. 

At the tree level, both the hZZ and hhh coupling constants of the THDM can largely 
deviate from the SM values due to the Higgs mixing effect. The hZZ coupling is given by 
the multiplication of the factor sm{(3 — a) to the SM coupling constant, where tan/? is the 
ratio of the vacuum expectation values and a is the mixing angle between CP-even Higgs 
bosons. In the limit of sin{(3 — a) = 1, where the hZZ coupling recovers the SM value, the 
hhh coupling also approaches to the SM prediction for a given mass of the Higgs boson h. 
We study how this correlation can be changed by the one loop corrections. 



We evaluate the one loop effects due to additional Higgs bosons as well as the top quark 



under the constraint from the perturbative unitaritv|33l.l34. 



35l | and the vacuum 

stabilityH- 



The constraint from the available precision data such as the p parameter constraint is also 



taken into account 



33,Q 



The one loop effect on the hZZ coupling can be as large as (minus) one percent of the SM 
coupling in the wide range of parameter space. This shows that a larger negative deviation 
can only be realized due to the Higgs mixing effect, i.e., the effect of the factor sin(/5 — a). If 
the observed hZZ coupling agrees with the SM prediction within the 1% accuracy, we may 
not be able to distinguish the quantum effect from the tree level mixing effect. 

The deviation in the hhh coupling can be as large as (plus) 100 percent for the mass 
of h to be around 120 GeV due to the non-decoupling quantum effect of the heavy extra 
Higgs bosons. This happens even in the SM-like limit, sin(/5 — a) 1. Such magnitude 
of the deviation is larger than the experimental accuracy that is expected to be 10-20 % 
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at LC'sp, lD, and can be experimentally detected. Therefore, the combination of precise 
measurements of the hZZ and hhh couplings can be useful to explore the structure of the 
Higgs sector. 

In Sec. m the form factors of hZZ coupling and hhh coupling are defined, and the SM 
contribution to them is briefly discussed. In Sec. IIIIl the general feature of the THDM 
is summarized, and the renormalization scheme of the THDM is defined. The one loop 
contributions to the form factors of the hZZ and hhh couplings are calculated in Sec. IIVI 
The analytic properties of the loop corrections are discussed in Sec. El and the numerical 
evaluation is shown in Sec. IVIl Sec. IVIII contains our conclusions. For completeness, we also 
present the details of our calculation in the Appendices. 



II. THE hZZ AND hhh COUPLINGS IN THE SM 



Before showing the calculation of the form factors in the THDM, it is instructive to 
discuss the top-quark loop effect on the hZZ and hhh couplings in the SM. One can find a 
simple example of the non-decoupling effect in the top-quark loop contribution. It is also 
useful as technical introduction to the calculation in the THDM. In Appendix we show 
details of the top-quark one loop contribution to the hZZ and hhh couplings in the SM. 

The most general form factors of the hZZ coupling can be written as 



Klz = M^^^gf^'^ + M^^^^ + M^^^ ^e'^^^P-^^, (1) 

where is the mass of the Z boson, pi and p2 are the momenta of incoming Z bosons, 
and we define g'^" = diag(l, —1, —1, —1) and e°^^^ = —1. The tri-linear hhh coupling of the 
Higgs boson is parameterized by 

Aelf = +-^^^hhhh^- (2) 
In the SM, the lowest order contributions to the form factors M^^^ and T^hh are given by 

j^hZZ{tree) _ 2m| j^hZZ{tree) _ j^hZZ{tree) _ g /^n 
1 W ' ^ ^ ' 

-ptree _ ^'"'h ( a\ 

^ hhh — ^ ' 

where is the mass of the Higgs boson. 



5 



Let us consider the loop contribution of the top quark to these form factors. Details of 
calculation are presented in Appendix ^ From the naive power counting, it is understood 
that M^'^^ receives the highest power contribution of the top quark mass among the form 
factors of hZZ vertex Ml^'^^ (z = 1 — 3). The leading one loop contribution of the top quark 
to the form factor M^^'^ is calculated as 



hZZ/J2 Jl Jl\ ^"^z 



2m 



--— <l + { — , — 



(5) 



where rrit is the mass of the top quark, pi {i = 1 — 3) represent the momenta of the external 
lines. The leading top quark contribution to M^^^ is the same as that to M^^^ , because 
of the isospin symmetry. Both have the quadratic power contribution of the top quark mass. 
On the other hand, the leading contribution of the top quark to the self-coupling constant 
is calculated jl^ as 



^hhhipl,Pl,Pl) 



3m 



V 



1 + C 



(6) 



The top-quark contribution is quartic in mass, so that we expect larger corrections to the 
hhh coupling than the correction to hZZ vertices by the enhancement factor of (32/5)m^/m^ 
especially when mh < rrit. Eq. (jUj) shows that the leading contribution of the top quark loop 
deviates the hhh form factor from the tree level value by about —12% for mt = 178 GeV 
and mfi = 120 GeV. The quartic dependence of the top quark mass is also reproduced easily 
in the effective potential method as shown in Appendix IA21 

At the future collider experiment, the hhh coupling will be measured via the double 
Higgs production processes, where at least one of the three legs of the hhh vertex is off-shell. 
Thus the momentum dependence in the hhh form factor is important. In Fig. 1, the top 
quark loop contribution to the effective hhh coupling Thkhig"^) is shown as a function of the 
invariant mass {^/(f) of the virtual h boson for = 100, 120 and 160 GeV. Thhh{q'^){= 
^khhiiTT-h^fT^hi l'^)) is evaluated from Eq. ()A34|) in Appendix I A II In the small >/q^ limit 
( — 0), the correction due to the top quark loop is negative and approaches to the similar 
value estimated from Eq. (jH)). However, such a value of -\/^ is lower than the the threshold 
2m^ of the subprocess h* hh, and kinematically not allowed. We find that the top-quark 
loop effect strongly depends on because the threshold enhancement at = 2mj 

contributes an opposite sign to the quartic mass term contribution. The correction changes 
the sign when is somewhere between 2mh and 2mt. The enhancement due to the top- 
pair threshold is maximum at the point just after the threshold of the top pair production. 
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FIG. 1: The one- loop contribution of the top quark to the effective hhh coupHng as a function 
of \/q^, where is the momentum of the off-shell h boson in h* hh. Ar5f°^(g2) is defined by 

rhhh{q^)-rt;:^m the sm. 

III. THE TWO HIGGS DOUBLET MODEL 



In this section, we give a brief review of the THDM to make our notation clear and 
to prepare some tree level formulas, which will be used for the one loop calculation in 
the next section. We consider the model with a (softly-broken) discrete symmetry under 
the transformation $i $i and $2 —^2, where $j are the Higgs iso-doublets with 
hypercharge |. This discrete symmetry ensures the natural suppression of flavor changing 
neutral current at tree level. Two types of Yukawa interaction are then possible; i.e., so- 



called Model I and Model II 



21[. In Model I, only $2 is responsible for generating masses 



for all quarks and charged leptons, whereas in Model II , $1 generates masses of down- type 
quarks and charged leptons and $2 gives masses of up-type quarks. In our analysis. Model 
II Yukawa interaction is assumed throughout this paper. Later, we will comment on the 
case that Model I is considered. 



The Higgs potential is given bv(21| 
ml |<l>i|^ + |$2|^ 

+ A3 |<l>i|^ |<I>2|V A4 



THDM 



$I$2 



($I<l>2 + <f5$l) +y |<fl|' + y |$2 

\ f 2 N 



+ 



(7) 



where , and Ai to A4 are real, while mg and A5 are generally complex. We here assume 
that there is no CP violation in the Higgs sector, so as to neglect the phases of m| and A5. 



A nonzero value of m| indicates that the discrete symmetry is broken softly. Under the 
assumption, there are eight real parameters in the potential (jTj). The Higgs sector of the 
MSSM is a special case of Eq. ([7j) with Model II Yukawa interaction at tree level. 
The Higgs doublets are parameterized as 



-j^{vi + hi + izi 



1,2), (8) 





where Vi {i = 1, 2) are vacuum expectation values that satisfy \/vf^-v^ = t; ^ 246 GeV. We 
here assume the case with viV2 7^ 0. From the vacuum condition (the stationary condition), 
we obtain 

= mlv2 - m\vx - - ^(^3 + A4 + A5)fif2, (9) 

= rrfy)x - m\v2 - ^^2v\ - ^(As + A4 + \-o)v\v2, (10) 

and the mass parameters vn\ and vtr^ can be eliminated with their degrees of freedom being 
replaced by those of V\ and V2- The mass matrices of the Higgs bosons are diagonalized by 
introducing the mixing angles /5 and a. First, we rotate the fields by /3 as 

Kd) \' \ a'"\\= m I " , h (11) 

with R{e) =1 """" I . (12) 

\ sin 6* cos^^ / 

By setting tan/3 = ^2/^1, the CP-odd and charged states are diagonalized. The Nambu- 
Goldstone bosons z and are massless if the gauge interaction is switched off, and their 
degrees of freedom are eaten by the longitudinal components of Z and bosons when 
the gauge interaction is turned on. The masses of the physical states A (CP-odd) and 
(charged) are expressed by 

ml± = M2-1(A4 + A5)^;^ (13) 
m\ = - Xr,v\ (14) 

where v is defined by f = a/w f + f | , and M is defined from the remaining degree of free- 
dom of the mass parameter mg by = mg/ sin/? cos/?. The CP even states are not yet 
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diagonalized, and the mass matrix for 0i^2 is given by Mfj, where 



= (AiCos^/5 + A2sin^/5 + 2Acos2/3sin2/3)^;^ (15) 

= (-AiCos^/? + A2sin^/3 + Acos2/3)cos/3sin/3v^ (16) 

= + ^(Ai + A2 - 2A)(1 - cos4^)v^ (17) 
8 

with A = A3 + A4 + A5. The diagonahzed CP-even states {H, h) are obtained from (0i, ^2) 
by the rotation with the angle {a — j3) as 



(18) 





The mixing angle {a — P) and the mass eigenstates are determined as 



2M^ 



and 



m]j = cos^(q; - /3)Mi\ + sin 2{a - P)M^2 + sin^(a - /3)M|2, (20) 
ml = sin2(a - (3)M^^ - sin 2(a - /5)M22 + cos2(a - f3)M^2, (21) 

respectively. The two physical CP-even fields h and H are defined so as to satisfy m,^ < m^. 
Among Mfj, only Mfg includes the dimensionful parameter M. In the limit of — > 00, 
we have tan 2 (a — (3) 0. The angle a is chosen such that ml — > Mf^, mj^ — > and 
sin(a — f3) ^ —1 are satisfied in the limit +cxd. ^ 

We note that the masses of the heavier Higgs bosons {H, and ^4) take the form as 



m. 



l = M^ + \v^{+0{v'/M^)), (25) 



^ Equivalently, we may rotate the CP-even fields from {h\, h-^) to {H, h) by the angle a directly. Then we 
obtain 

- (A:s + A4 + AO(;-[sill2,i 

tan 2a = ^-^ ^ >) i _ — .22) 

(M2-Aiw2)cos2/3-(M2-A2t;2)sin2/3' ^ ' 

and 

rn^H = sin^(a - /3) + (Ai cos^ acos^/3 + A2sin^ + iAsin2asin2/3)?;^, (23) 

m\ = M2cos^(a- ^) + (Aisin2acos^/3 + A2Cos^asin2/3- iAsin2asin2/3)w2. (24) 
One can easily check that the above two expressions for and rrijj are equivalent. 



where $ represents or A and Aj is a linear combination of A1-A5. When 3> AjW^, 

the mass m| is determined by the soft-breaking scale of the discrete symmetry M^, and 
is independent of Aj. In this case, the effective theory below M is described by one Higgs 
doublet, and all the tree level couplings related to the lightest Higgs boson h approach to 
the SM value. Furthermore, the loop effects of $ vanish in the large mass limit (m^ 00) 
because of the decoupling theorem j33]. The MSSM Higgs sector corresponds to this case, 
because Aj is fixed to be 0{g'^) so that large mass of $ is possible only by large values of 
M. On the contrary, when is limited to be at the weak scale (M^ < A^f ^) a large value 
of is realized by taking Aj to be large; i.e., the strong coupling regime. In this case, the 
squared mass of $ is effectively proportional to Aj, so that the decoupling theorem does not 
apply. Then, we expect a power-like contribution of in the radiative correction. We call 
such an effect as the non-decoupling effect of $[28, Similar non-decoupling 

effect appears in considering the top quark loop contributions in the SM. Although we 
expect large loop effects in this case, theoretical and experimental constraints must be 
considered. For instance, too large Aj leads to the breakdown of validity of perturbation 



calculation 



33, 



34 



Furthermore, the low energy precision data also impose important 



constraints on the model parameters 



40|. Later, in our evaluation of the one loop from 



factors, we shall take into account these constraints. 

The parameters of the Higgs potential are m^-m| and A1-A5. They can be rewritten 
by eight "physical" parameters; i.e., four Higgs mass parameters mh,mH,TnA,'rnH±, two 
mixing angles a, /?, the vacuum expectation value f, and the soft-breaking scale of the 
discrete symmetry M. The quartic coupling constants can be expressed in terms of these 
physical parameters as 

Ai = -T, ^ (— sin^ /3M^ -|- sin^ am? -|- cos^ am^) , (26) 

f'^cos'^p ^ ' 

A2 = — n — (— cos^ /5M^ -|- cos^ am^ -|- sin^ am^) , (27) 

sin (3 

m'i,^ 1 sin2Q;, n n, 
A3 = Y + 2^ + < - 28 

A4 = ^ (M2 + ml- 2m^±) , (29) 

A5 = ^ (M^ - ml) . (30) 
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IV. ONE LOOP CORRECTION TO hZZ AND hhh IN THE THDM 



We here discuss our scheme for calculating the one loop corrections to the form factors 
of hZZ and hhh in the THDM. As we are interested in the Higgs non-decoupling effects, 
we neglect the loop contributions of the gauge bosons in the calculation. This procedure is 
justified by adopting Landau gauge, where the effect of the gauge bosons and that of the 
Higgs bosons can be treated separately. The renormalization is performed in the on-shell 
scheme for physical mass parameters and mixing angles. 

First, we renormalize the three SM input parameters m^, and Gp (= The 
counter terms of gauge boson masses ((^m^, (5m|) and the wave function renormalization 
factors {?)Zy^^ ^Z^) are obtained by calculating the transverse part Hj^^(p^) of the two-point 
function: 

K^ip') - {-9.^ + ^-f) nr(P^) + ^nr^(p^), (31) 

where VV — WW or ZZ. In the on-shell renormalization scheme, we obtain 

5ml = ReH^^^^'Vv), (32) 



6Zy = - ^ReTf/^'^^p') 



(33) 



The renormalization for the vacuum expectation value 5v {v ^ v -\- 5v) is defined by 
Sv 1 1 

— = - — TT^^^ {^) + (vertex and box corrections). (34) 
V 2 

When neglecting the vertex and box contributions, which are 0{aEj^), 5v/v can be expressed 
solely by the oblique correction H^^(O).^ 

Next, let us define the renormahzation scheme for the Higgs sector. In addition to v, 
the bare parameters of the Higgs potential are ml^,m'jj,m\,m'j^±,a, (3, M'^.Tf^.T^j, where 

and are tadpoles of h and H, respectively. The tadpole parameters arc fixed by the 
stationary condition at each order of perturbation. At the tree level, we set Th — Tjj — 0, 
while at one loop level and Th are chosen to make the renormalized one-point functions 
for h and H to be zero. They are expressed in terms of the Lagrangian parameters as 

Tjj — cos a + T^ sin a, = —T^ sin a + T^ cos a, (35) 



^ It is straight forward to sec the difference from the other renormahzation schemes in which the SM inputs 
are taken as (a, m^, Gp) or (mjy, to^, ^bm)- The difference is of order a which is neglected in the present 
calculation. 
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with 



1 1 

Ti = mlv2 - mlvi - 2^i^i ~ 2*-"^^ + -^4 + A5)fif2, 
T2 = mlvi - mlv2 - Y^2vl - ^(As + A4 + X-,)vlv2. 

The renormahzed parameters are defined by shifting the bare parameters as 



(36) 
(37) 



a 

M2 



+ ST,,H, 
+ 

a + 6a, 
(3 + 5(3, 



(38) 
(39) 
(40) 
(41) 
(42) 



where (pi represents H, h, A and H^. The introduction of the wave function renormahzation 
factors for the Higgs bosons is rather comphcated because the mixing between scalar bosons 
with the same quantum number should be taken into account. According to the method 
explained in Appendix O we define 



(43) 



where SZh (SZh) is the wave function factor of h (H). Similarly, for the CP-odd scalar 
bosons and the charged scalar bosons we define 



H 




1 + \5Zjj 5a + 5Ch 




H 


h 




-5a + 6Ch l + \5Z^ 




h 



z 




1 + \5Z, 6(3 + 6Ca 




z 


A 




-6P + 6Ca 1 + ^SZ^ 




A 



(44) 



and 







1 + 15Z^^ 5(3 + 5Ch+ 










-6(3 + 6Ch+ l + \5Z^± 







(45) 



respectively, where 5Za ^Zjj± are the wave function renormahzation factors for the physical 
CP-odd and charged Higgs bosons A and if^. In addition, we introduced the "wavefunction" 
factors 6Zz and 6Z^ for the Nambu-Goldstone bosons z and w^, which are massless in the 
Landau gauge. However, 6Zz and SZ^ will not be used in our calculation. 
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There are sixteen counter-term parameters {STh^n, ^'^tpn SCh, SCa, SCh+ 

and SM"^), where 0^ = H,h,A and if^, and 6Ch, SCa and SCh+ are defined via Eqs. 
(I45p ■ The first fifteen of them are determined by imposing the renormahzation condition to 
the one and two point functions. The conditions are shown below in order. 

The tadpole condition requires that the renormalized one-point functions for h and H 
must satisfy 

r, = o, r^ = o, (46) 

with rh,H = T^^^ + 5Th,H- Thus, 

'5T, = -Tf\ 5T^ = -Ti\ (47) 

where T^^^ are the contributions of one-particle-irreducible (IPI) diagrams. The explicit 
expressions of the contributions to T^^^ in the THDM are given in Appendix ^ 
The relevant renormalized two-point functions for /i, H, A, can be expressed as 

^ , 9, „ipT/ 9^ f / 9 9x/ „ s ,-9 slu^ o ^Ti cos^ a STo^ , , - 
r..(/) = nr(/) + |(/ - + iZ,) - ini + — ^ + . (48) 

^ , 9, „1PT / 9^ f/Q 9^/ r^N r9 COS^ « (^Tl SlU^ « (5T9 1 

r..(.^) - n- (,^) + |(,^ - 0(i + ^z,) - ^< + — ^-i + -^^1 (49) 



fsin^P ^ I \ 6Ti /cos^Z? 
cos p H ' 



\ cos (3 cos 13 J 2v \ sin /5 



sm/5 + -^)^|, (50) 
sm p J 2v ) 



where nj^^^(p^) are the IPI diagram contributions to the self energies. Their expressions and 
those of 6Ti and 6T2 are summarized in Appendix El 
By imposing the on-shell conditions 



d 

Rer^^^,(mJJ = 0, -^ReT^^^^ip^] 



= 1, (52) 



where (pi represents h,H,A and if^, we determine Smi, Smj^, Sm\, Smj^^, 6Zf^, 5Z^, 5Z^ 
and 5Zr 
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The condition that there is no mixing between CP-even scalar bosons h and H on each 
mass shell; i.e., 



r,Himl) = 0, r,^(m^) = 0, (53) 
determines 6a and SCh, where 

r,^(/) = fl.Hip') + {2p' -ml- ml)6CH - {m\ - ml)6a, (54) 

with 

n.„(p') - m + COS „ „ (--L.^Ii , _1.^) . (55) 

Hence, we obtain 

1 1 



Sa = :t lUhHirriH) + IlhH{ml)\ , (56) 

2 m jj — I J 

5Cu = / , {tlMml) - fl,H{ml)] . (57) 

The expression of the IPI diagrams Il,^jj{p'^) can be obtained from those of Hi^jj, STi and 
6T2 in Appendix FBI 

The parameter 6(3, 6Ca and 6Ch+ are determined by the conditions for the two-point 
functions of z-A and w^-H^ mixings. For the CP-odd sector, we require 

r.A(o) = 0, (58) 
r.A(^i) = 0, (59) 



where 



T^^ip') = U^^ip') + {2p' - m\)6CA + m\6(3, (60) 



with 



Ka{v') = ^Z\P') - sin/?^ + cos/3^. (61) 

Due to the Nambu-Goldstone's theorem, 11^^(0) = is ensured, so that we obtain, from 
Eqs. (1^ and 

5Ca = 6(3 = --l^n,^(mi). (62) 
14 



For the charged sector, from the condition 

r.±H^(0) = 0, (63) 

where 

T^^H^ip') = U^^hAp') + (2p2 - ml^)6CH+ + ml^6f3, (64) 

with 

n^±^,(p2) = U'JIhAp') - + cos/?^, (65) 

we obtain 

SCh+ = (66) 

We note that due to the Ward-Takahashi identity, the condition is equivalent to the 
following condition on the mixing between the gauge boson and the Higgs boson: 

rzA«) = 0, (67) 
where the two-point function of ZA is written as 

^Up') = -w'^za{v\ (68) 
and the form factor r^^(p^) is expressed as 

rzA(/) = (5/5 + ^CA)m^ + rE^(/). (69) 

In the above equation, the counter term parameters [8^ + 8Ca) comes from the Higgs 
kinematic terms of the Lagrangian as the consequence of the shift of the parameters: 

^ +i6p + 6CA)mzid,A)Z'^ + ■■-. (70) 

With the expressions of r^^(p^) and rl.^^(p^) presented in Appendix lEl one can explicitly 
check the equivalence of the conditions of Eqs. and (|U7|). Similarly, instead of the 
condition (jSHI), the alternative condition 

r.±i^^(^i±) = (71) 
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may be used to determine 5j3. In this case, 513 (let us denote it as 5f3') is given by 

5(3\= 5C'h+ = 5C'^) = --I^II^^hA^I^)- (72) 

It is easy to check that the difference between 5/5 and 5(3' is finite. This finite difference is 
due to different choice of renormalization prescription in loop calculations. In this paper, 
we adopt 5 [3 determined from Eqs. and 

We have determined all the renormalization parameters but 5M'^ of the Higgs sector by 
applying the renormalization conditions to various one- and two-point functions. However, 
the renormalization of has to be discussed in the context of three-point functions. Below, 
we consider the renormalization calculation for the three-point hZZ and hhh vertices. 

The tree level hZZ coupling can be read out from the kinematic term of the Lagrangian: 

9 2 

I^KZZ = +-f sin(/3 - a)g^,Z^Z^h + -f cos(/3 - a)g^,Z^Z^H. (73) 
In terms of the general form factors of the hZZ coupling, cf. Eq. (^, we get 

^hZZ(tree) ^ ^gj^^^,^)^ ^^^^^^^ = M^^^^*""^^) = 0. (74) 

On the other hand, the tree level coupling constants of hhh and hhH are given from the 
Higgs potential. By using the mass relations of Eqs. - (jHUj) . each coupling constant can 
be expressed in terms of Higgs boson masses and mixing angles: 

-1 



A 



''^'^ 4t; sin 2/3 



I cos(3a-/3)-h3cos(a-F/3)|m^-4cos^(a-/3)cos(a-h/3)M^ , (75) 

Xuhfj = -l cos(a — /5) sin 2a(2m? -|- m?r) — cos(q; — /?) (3 sin 2q; — sin 2/?) I ,(76) 

2v sin 2p I J 

The tree level form factor for the hhh coupling, T^^l'i^\ is thus given by 

Note that in the SM-like limit {a = (3 — 71/2), the form factors of hZZ and hhh couplings 
take the same form as in the SM: 

j^hZZ{tTee) _ 2m\ ^hZZ{tree) _ j^hZZ{tree) _ q /-gx 

1 i; ' ^ ^ ' 

r£r^ = (79) 
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while the heavier Higgs boson H does not couple to the gauge bosons and also X^hH — 0- 

Now, we discuss the renormalized vertices of hZZ and hhh. Prom the kinematic term 
of the Higgs sector, we obtain the counter terms to the form factors of the hZZ vertex as 
follows. 

2 2 

f^hzz = -^^v^{a-i5)g^,Z^Z^h^^co^{a-i5)g^,Z^Z^E 



sin(a - /3) 1 + + 5Zz + -5Zh 



I \ — '/I ' V ' Zj ' n 

V I \ 1717 V 2 



+ cos{a - P){-5(3 - 5Ch)j g^^Z^Z^'h + • • •. (80) 



Thus, we obtain the counter terms for the hZZ form factors as 

5ml 5v 

— 2 ^'^^^ ■ o 

+ cos(a-/3)(-5/3-5a)}, (81) 

5M^^^ = (5M3^^^ = 0. (82) 

The counter term for the hhh vertex is obtained from the shifting the bare hhh coupling 
^^hhh wave function and mixing renormalization of the hhh and hhH vertices as 

\hh ~^ \hh + ^\hh^ (83) 

hhh ^ i^(^l + ^dZh^h + ---^ ^ (^l + ^dZh^h' + --; (84) 

hhH ^ { + l^^h^ h + ■ ■ -"^ \^{6a + 6Ch) h + ■ ■ - ^ ^ {6a + 6Ch) h^ + ■ ■ ■. (85) 
Thus, the counter term for the ^^hh obtained as 

S'^hhh = 3! I^SX^^f^,^ + ^X^^f^,^6Zh + X^i^H i^oc + 6Ch) | (86) 

= 3!A,,, - ^) + 3!A,,^5C, + Ci5m^ + C25a + C^5(3 + C45M^ (87) 



where 



Ci = - — r^{cos(3Q;-/3) + 3cos(Q; + /3)}, (88) 

sill 

C2 = / cos(Qi-/3)sin2Qi(m|-m^), (89) 
Iv sm 2p 

C3 = T^^"' [| 4 + COS 2(a - /?) + 3 cos 2(a + /3) | 
Av sm 2p L L J 

- |5 + cos2(q;-/3) -cos4/3 + 3cos2(q; + /3) I , (90) 

C4 = cos^(Q;-/?)cos(a + /?). (91) 

■usin 2/5 
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Up to now we have not explicitly discussed the renormalization condition to determine the 
counter term of the soft-breaking mass, 5M^. We chose to fix this parameter in the minimal 
subtraction method. Namely, we require the condition that the remaining divergent term 
proportional to A = 1/e + In/x^ in the hhh vertex is canceled by the counter term (5M^. In 
the present model, dM"^ /M'^ is found to be 
5M^ 1 



M2 Wv"^ 



2Nc{m; cor (3 + m; tan^ (3) 
+4M2 - 2mi± -ml+ - m2)| A, (92) 



where A = 1/e + In/x^ with D = A - 2e. 

Finally, the renormalized form factors for hZZ and hhh couplings are calculated by 

M^'iplpl q') = Mr^'-^ + Mr^''''\plpl q') + 5Mf^^ (^ = 1 - 3), (93) 

^hhM.pI <f) = + ^'Zivlvl <f) + 5r,,„ (94) 

where the momentum in Eq. ()93|1 is that of the external Higgs boson line, and all the 
counter terms are completely determined by the renormalization conditions in Eqs. ()46p. 
(El), dSni), (EH), dSni), dSni) and dig)- ah the explicit results for the IPI diagrams which 
contribute to the form factors are summarized in Appendix El 



V. LARGE MASS EXPRESSION IN THE SM-LIKE REGIME 

The renormalized coupling constants hZZ and hhh are evaluated by the formulae given 
in Eqs. fl93|) and (jMj) . The deviation from the SM predictions can occur due to two sources: 
the mixing effect which appears in the tree level, and the quantum correction effect due to 
the loop contribution of the extra Higgs bosons. If the mixing between the two CP-even 
Higgs bosons is large (e.g., sin(a — ~ 0.3-0.7), the hZZ form factor Mf^^ in the THDM 
significantly differs from the SM prediction already at tree level by the factor of sin(/5 — a); 
cf. Eq. fl74|) . In such a case, we may be able to obtain an indirect but explicit evidence of 
extended Higgs sectors at the LHC or at the early stage of the LC experiments. 

On the other hand, the hZZ coupling may be close to the SM prediction; i.e., in the 



SM-like regime 



El 



where sin (a — /5) ~ 1. Define x = [3 — a — /2. Asx^l, the tree level 



hZZ and hhh couplings can be expressed as follows: 



j^hZZ{tree) ^ 2m| 



[l-\x' + 0{x^)^^ (95) 
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r,»=,_M(i4fl-i^).^ + OML (96) 



VI 2 \ 3m'f^ 

In the limit of x — 0, the mixing effect vanishes and the hZZ and hhh couphngs coincide 
with the SM formulas. From Eq. (jUBj) . we find that in the SM-like regime the hhh coupling 
constant is reduced from the SM value as long as > 3m|/4. Keeping only the leading 
one loop contributions of the heavier Higgs bosons and the top quark, the expressions for 
the one loop corrected hZZ and hhh couplings are given in the SM-like regime (x ^ 1) as 




2 647r2t;2^ ^ ^ ^ ' 967r2i;2 V 

V V 
4 



127r2m^t'2 




67r2m^f2 y '>t^'h± J Svr^m^f^ y ' f^m^ ' 'tJ^m^' 

where represents the masses of the heavier Higgs bosons H, A and H^.^ As expected, 
there are quartic power terms of the heavier Higgs boson masses in F^^^. The difference 
from the top-mass contribution is the suppression factor of (1 — M^/m|,)^ and the sign. 
The large correction occurs in the case of small M^. The largest corresponds to the limit 
of ^0. In this case, a greater positive deviation from the SM prediction is obtained 
for a larger m$. However, since m| is originated from the electroweak symmetry breaking 
and is proportional t o Ay, , a too large value of m|, is forbidden by the requirement of the 
perturbative unitarity 33|. Furthermore, the direction of the deviation induced by the heavy 
Higgs boson (bosonic) loops is opposite to that by the top quark (fermionic) loops. 



^ Although the expression in Eq. H98|) does not depend on tan/3, the allowed value of tan/3 is constrained 
to be 0(1) due to the requirement of the perturbative unitarity when large values of are taken with 
AI — 0. Hence, the large deviation from the SM prediction occurs at tan/3 ~ We note that the 

parameter set = = m^±, M = 0, a = (3 — tt/2 and tan/3 = 1 corresponds to Ai = A2 = A3 = 
(m^j + m|j)/u^ and A4 = A5 = —rrij^/v^ at the tree level. 



19 



300 



^200 



I 100 



M=0 (Max. Non-Decoupling Case) 

sm(a-P)=l 

m/=mi=m^ (=mj 



m=100GeV 




200 300 

(GeV) 



500 



FIG. 2: (AA^^^*^/Af^^) is shown as a function of m$(= m^j = = m^±). The results of 
the full one loop calculation are shown as solid curves, while the quartic mass (m^) contributions, 
given in Eq. (|^S)) . are plotted as dotted curves. 

VI. NUMERICAL EVALUATION 



In this section, we present results of our numerical evaluation for the effective hZZ and 
hhh couplings predicted by the SM and the THDM at the one loop order. We define the 
deviation from the SM prediction by 

Mr (™^)(^^ ml, ml) - m|, ml) 



9hzz 



V ■^hhh 



Ml 



hZZ{SM)( 2 



{q^,m%,ml) 



rlfr^K, <, <l') - TL^iK, ml q^) 



(99) 
(100) 



where the SM form factors M'^^^^^^\pl,pl,q'^) and ^hhhiPi^Ph q'^) ^^re evaluated by using 
Eqs. flX33|l and (ICTjl . and those of the THDM, M^^^^^^^^^\plplq^) and T'lj^iipl pi q^) , 
are given by Eqs. ()93p and ()94p. In the following numerical analysis, we fix = 2mh 
except for Fig. 4. We show the momentum dependence of the deviation in the hhh form 
factor in Fig. 4. Throughout this section, the mass of the top quark is set to be mt = 175 
GeV. 
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FIG. 3: The decoupling behavior of {^^'hhh^^^ / ^hhh) is shown. The mass of the heavy Higgs 
bosons m$(= rrijj = = m^±) is given by m\ = + M^. 

A. The SM-like limit 

First, we show the results in the SM-like limit (sin^(a — /9) = 1 or x in Eqs. ()97|1 
and ((HHI)), where the tree level expressions are coincide with the SM ones; cf. Eqs. (I95p and 
()96p. In this case, the contributions to Agf^J^*^ and AA^;^^*^ only comes from radiative 
corrections. The form factor M^^'^ receives the one loop effect of (9[m|/(167r^f ^)] due to the 
heavy Higgs boson $ ($ = if, A and H^) with the suppression factor (1 — M^/m|)^. When 
M = 0, where the non-decoupling loop effect is maximal, the magnitude of the deviation 
^9hzz"^ /9h¥z becomes typically at most 0{1) %. On the other hand, the loop effect for 
the hhh coupling is (9[m|,/(167r^f ^m^)] with the suppression factor (1 — M^/m|,)^. The 
magnit ude is larger than that for the hZZ coupling by the enhancement factor of m|,/m^ 
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14l |. In Fig.|21 the one loop contribution of the heavy Higgs bosons to the hhh coupling is 



shown for rrih = 100, 120 and 160 GeV as a function of m^, where = rrifj = rrij^ = m^±, 
by assuming s\r?{a—[3) = 1 and = 0. The deviation increases rapidly for large m<j, values 
due to the quartic power dependence of m^, and it amounts to 50 (100) % for = 300 
(400) GeV for rrih = 120 GeV. The larger deviation is obtained for the smaller value of 
m^j. The small "peak" structure in Fig. |21 originates from the threshold contribution when 
m$ = rrih for Vy ~ 2m/i, where Wq^ is the invariant mass of the virtual h, i.e. the invariant 
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FIG. 4: The momentum dependence of (AA^^^^^/A^^) is shown, where ^/q^ is the invariant 
mass of h* in h* hh, for each value of (= nifj = = mjj±) when rrih = 120 GeV, 
sin(a - (3) = -1 and M = 0. 

mass of the two on-shell h Higgs bosons in the hhh vertex. 

For non-zero values of M (0 < < m|), the magnitude of the loop correction is 
suppressed by the factor (1 — M^/m|)^, and the non-decoupling effect vanishes when M ~ 
m^. In Fig. 3, we show the decoupling behavior of the heavier Higgs contribution as a 
function of M with fixed V Af ^ = 200 — 450 GeV, in the case of sin^(a — P) = 1 and 
= 120 GeV, where the mass of the heavier Higgs bosons (= = rrifj = mH±) is 
given by m| = Xv'^ + M^. (We note that A corresponds to Ai cos^ + A2 sin^ /? — mfjv'^ = 
A3 — m\/v'^ = — A4 = — A5 in this case.) As shown, the heavier Higgs boson contributions 
reduce rapidly for a larger value of M. Nevertheless, a few tens of percent of the correction 
remains at M = 1000 GeV. 

In Fig. 4, we show the momentum dependence of the deviation in the effective hhh 
coupling, Thhhi'f) (= ^hhh{'i^\,'rn'h,'f')), from the SM result as a function of the invariant 
mass (a/^) of the virtual h boson, for various values of (= = = mH±) with 
sin^(Q; — /?) = 1 and rrih = 120 GeV. Again, to show the maximal non-decoupling effect, we 
have set M to be zero. The Higgs boson one loop contribution is always positive. Below the 
peak of the threshold of the heavy Higgs pair production, ThhhiQ"^) is insensitive to \/q^. We 
note that the low (but > 2m/j) is the most important region in the extraction of 
the hhh coupling from the data of the double Higgs production mechanism, because the h* 
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FIG. 5: Deviation of the one loop renormalized (solid curves) and tree level (dotted curves) form 
factor M^^^ from the SM value is shown as a function of 6 = cos^(a — /?) for various M values. 
The other parameters are set to be m^^ = 120 GeV, tan/3 = 2, and rrijj = rn^± = = 300 GeV. 



propagator l/(q'^ — mj^) in the signal process becomes larger. On the contrary, as we have 
shown in Fig. ^ in Sec. m the fermionic (top-quark) loop effect strongly depends on 



because of the threshold enhancement at 



g2 = 2m^. 



B. The mixing angle dependence 

Here, we study the case in which the condition of x = (or, sin(a — (3) = —1) is relaxed. 
When sin (a — (3) is much different from —1, the renormalized couplings are significantly 
different from their SM values because of the tree level mixing effect jiol. Our main 
interest is rather the case in which the condition sin(a — /3) = — 1 is only slightly relaxed; 
i.e., sin(a — /5) ~ — 1 or x <^ 1. We refer such a case as the SM-like regime of the THDM. 
In order to study this case, we introduce the parameter 6 = cos^(a — (3) = 1 — sin^(a — (3) 
(~ x^) which directly measures the deviation from the decoupling limit. In Figs. El and 
we show i^OhzF^^ / 9hzz) i^^JihyF'^^ l\hh) a function of 5, respectively. The value of 
'mq, (= — ""^A — ""^Hi) GeV. We consider the case of ruh = 120 GeV and 

tan/? = 2, and the scale M is taken to be 0, 'm^/2, niA/V^ and niA- The solid curves are 
the results for the one loop corrected couplings, and the dotted ones are for the tree level 
couplings. 

As shown in Fig. the tree level mixing effect on the hZZ coupling is proportional to 
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FIG. 6: Deviation of the one loop renormalized (solid curves) and tree level (dotted curves) hhh 
form factor from the SM value is shown as a function oi S = cos^(a — (3) for various M values. The 
other parameters are set to be = 120 GeV, tan/3 = 2, and rrijj = = = 300 GeV. 

6 and the deviation from the SM value is negative. The non-decoupling effect on the hZZ 
coupling is insensitive to 6 as long as 6 is not large, and its deviation is less than one percent 
to the negative direction. The non-decoupling effect becomes maximal for M = 0, and 
minimum for M = 771^^. 

Fig. ini shows that the deviation in the tree level hhh coupling can vary due to the Higgs 
mixing effect from —80 to +10 percent for 5 = 0.1, depending on the value of < M"^ /m\ < 
1. The deviation of the tree level hhh coupling vanishes as 5 = 0, which reproduces the 
SM case. For the fixed value of S, smaller gives larger value (in magnitude) of the tree 
level hhh coupling. At one loop level, the non-decoupling effect of the heavy Higgs bosons 
gives large positive corrections to (AA^;^^*^/Af^^). Due to the non-decoupling effect, the 
deviation in the one loop hhh coupling can be plus 40 percent for M = 0, even when 6 = 0. 
Though the deviation decreases when 6 increases, such large positive contribution remains 
for 6 = 0.1. For M = m<j,/2 the magnitude of the non-decoupling effect is smaller than that 
for M = 0. However, the deviation can still be larger than that induced at tree level by the 
Higgs mixing effect for < M^/m| < 1, especially in the region of < 5 < 0.06. 

In conclusion, the large non-decoupling effect of the heavier Higgs bosons contributing in 
loops can be more important than the tree level Higgs mixing effect, as long as 6 is not too 
large. 
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Case 1^=0 




FIG. 7: Allowed region of the deviation in the form factor M^^^ under the constraints obtained 
from perturbative unitarity and vacumn stability as a function of 6{= cos'^(a — (3)). We set 



m 



H 



= m^-t, and the value of M is fixed to be in order to study the maximal non- 



decoupling effect. The upper and lower limits for the one loop renormalized couplings are shown 
as solid curves. The value of the tree level one is shown as the dotted curve. 

C. The possible allowed region of the corrections 

Finally, we study possible allowed range of the deviation in the hZZ and hhh couplings 
from the SM predictions under the experimental and theoretical constraints. The free pa- 
rameters of the Higgs sector in the THDM (m/i, m^., rrij^, mj^±, a, (3 and M) are constrained 
by theoretical consideration as well as the available experimental data. These are related 
to the quartic coupling constants in Eq. ((7j) by Eqs. (PBjl to (jHUj) . We take into account the 
following bounds in order to constrain the parameters. 

(i) The coupling constants Aj (i = 1 — 5) are constrained by the requirement of perturbative 
unitarity[34], which is described by the condition on the S wave amplitudes for the elastic 
scattering of longitudinally polarized gauge bosons as well as the Higgs bosons 3^ ; 



;ioi) 



where a^^^ip^Lp^ — > ipfjipj^) is the S-wave amplitude for the elastic scattering process (Pj^^p^ 
(Pc'^D of the longitudinally polarized gauge bosons (and Higgs bosons); cf. Appendix D. 
The critical value ^ is a parameter, and we here take = 1/2 in our a naly sis 21 1. 
(ii) The condition of vacuum stability is expressed at the tree level byj36| 

Ai > 0,A2 > 0, 



25 



600 



400 



200 



< 



-200 





Case 1^=0 




loop (max) 


- 


tree {mox) 








loop (min) ^^'"'-^^ 



0.0 0.1 0.2 0.3 0.4 0.5 
6 

FIG. 8: Allowed region of the deviation in the hhh form factor under the constraints obtained 
from perturbative unitarity and vacuum stability as a function of 6{= cos'^(a — P)). We set 



m 



H 



= m^-t, and the value of M is fixed to be in order to study the maximal non- 



decoupling effect. The upper and lower limits for the one loop renormalized couplings are shown 
as solid curves. Those for the tree level couplings are shown as dotted curves. 



V^A^ + As + MIN(0, A4 + A5, A4 - A5) > 0. 



(102) 



(ill) The LEP precision data imposed strong constraints on the radiative corrections to the 
gauge boson two-point functions, which are parameterized by the S", T and U parameters^]. 
In the THDM, the T parameter (~ a^j^^Ap, where Ap(~ 10~'^) is the deviation of p param- 
eter from unity) can receive large contributions. The analytic formula for Ap in the THDM 
is given, for example, in Refs. 37, 3^. To satisfy this constraint, the THDM has to have an 
approximate custodial {SU{2)y) symmetry 42|. In the Higgs sector of the THDM, there are 
typically two options for the parameter choice in which SU (2)y is conserved according to the 
assignment of the SU{2)v charge; (1) Tn^+_^ m^, and (2) mjj± ^ with sin^^a — P) ~ 1 
or m^± ~ with cos^(q; — /?) ~ 1 33, |42]^. In the present paper, we do not perform a 
complete scan analysis for all the parameter space. Instead, we set rrifj 



m^± m 



order to reduce the number of parameters. By the degeneracy of heavy Higgs bosons, the 
constraint from the p parameters is satisfied. Then, the free parameters are m^, tan /?, M 
as well as 5 (or a). 

In Figs. El and we show the allowed region of {^glzF'''^ / QhMz) and {AXl^,f^^ / X^^i) for 



In terms of the coupling constants, these conditions are expressed by (1) A4 = A5, and (2) Ai = A2 = A3 
with rrii — m\. 
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FIG. 9: Allowed region of the deviation in the form factor M^^^ under the constraints obtained 
from perturbative unitarity and vacumn stability as a function of 6{= cos'^(a — (3)). We set 



m 



H 



= m^±(= m^), and the value of M is fixed to be The upper and lower limits 



for the one loop renormalized couplings are shown as solid curves. The value of the tree level one 
is shown as the dotted curve. 
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FIG. 10: Allowed region of the deviation in the hhh form factor under the constraints obtained 
from perturbative unitarity and vacuum stability as a function of 6{= cos^(a — /?)). we set = 



m , 



m 



fj±{= m^), and the value of M is fixed to be The upper and lower limits for the 



one loop renormalized couplings are shown as solid curves. Those for the tree level couplings are 
shown as dotted curves. 

M = as a function of 5 (0 < 5 < 0.5), respectively. The mass of the hghtest Higgs boson is 
set to be ruh = 120 GeV. In Fig. [7[ we find that the non-decoupling loop effect on the hZZ 
coupling is at most a few percent. Due to the leading contribution of the additional Higgs 
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bosons, the correction becomes negative. Most of the deviation from the SM prediction 
comes from the tree level mixing effect of the factor sin^(a — On the other hand, as 
shown in Fig. |H1 due to the non-decoupling effect of the heavy Higgs bosons the allowed 
region of AA^^^^^/Af^^ becomes much wider than that for the tree level. The correction 
can be as large as a few 100 %. We note that such large deviation from the SM prediction 
cannot be realized solely by the tree level Higgs mixing effect for < 5 < 0.5. 

As the typical case for the non-zero value of M, we show the result for M = in 
Figs, inland EH where = rrifj = rrij^ = m^j^. All the other parameters are taken to be 
the same as those in Figs. [7| and |H1 As shown, the magnitude of the non-decoupling effect 
becomes smaller as compared to the case with M = 0, both in the hZZ and hhh couplings, 
because of the suppression factor (1 — M^/mD"; cf. Eqs. fl^ and (jHEl)- In the hhh coupling, 
the tree level mixing effect becomes significant for larger values of 5, by which the positive 
contribution due to the non-decoupling effect is canceled: cf. Eq. (jHE))- The deviation from 
the SM prediction can be larger than a few 100% for the small values of 5. 

Some comments are in order related to the unitarity constraint. If we take ^ = 1 3| 
instead of ^ = l/2j2l|, the constraint from the perturbative unitarity is relaxed on both the 
tree level and loop effects. Then larger values of can be taken, so that the possible en- 
hancement due to the non-decoupling loop effect becomes greater. The rate of enhancement 
due to the change from ^ = 1/2 to ,^ = 1 is much larger at one loop level than that at tree 
level. 



D. Discussions 



Before concluding this section, we give a few comments on our analysis. 

The large one loop radiative correction of 0{1) to the coupling Xhhh in the THDM does 
not imply the breakdown of the perturbative expansion, because the large contribution 
originates from new types of couplings, e.g., A^^^ and \hh<^<i) that enter in loop calculations. 
Needless to say that we do not expect such kind of large correction to occur beyond the one 
loop order. 

We have shown the results by assuming Model II for the Yukawa interaction. In the case of 
Model I, our main results presented thus far are essentially unchanged when h approximately 
behaves like the SM Higgs boson. It is well known that in Model II, the 6 — 57 data imposed 
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a strong constraint on the mass of the charged Higgs boson. We have not exphcitly included 
the constraint from the b ^ s'~f data^^ in our analysis, which can be easily satisfied by 
assuming that the mass of the charged Higgs boson is larger than about 300 GeV. In Model 
I, there is no such strong constraint from the b —>■ sj data. 

The measurement of the hZZ and hhh couplings are important not only to confirm the 
mechanism of the electroweak symmetry breaking, but also to indirectly explore the property 
of new physics beyond the SM. In particular, when the lightest Higgs boson h is found to 
be around 120 GeV at the LHC or LC's, and if its coupling with the gauge boson {hZZ or 
hWW) is SM-like, the measurement of the hhh coupling becomes important to determine 
the scale of the new physics. If the measured hhh coupling turns out to be much larger 
than the SM prediction and is not possible to be explained by the tree level mixing effect 
in the THDM, we may consider the strongly coupled THDM with a relatively low cutoff 
scale. Such large deviation in the hhh coupling could be the first indirect signal for the 



models of dynamical symmetry breaking|22], or models of electroweak baryo gene sis|23l. \44 
Otherwise, the model with a light h should indicate a weakly coupled theory |45[. 

The trilinear coupling of the lightest Higgs boson can be measured from studying the 
scattering processes e"'"e^ — > Z* Zh* Zhh and e"'"e~ i'vW^*W~* vvh* vvhh 
in the e^e" collision, and 77 —>/;,* hh at the 77 option of the LC. In Fig. 4, the momentum 
dependence on the self-coupling has been shown in the SM-like limit. The corrections turned 
out to be insensitive for the energy below the threshold of the pair production of the loop 
p articles jl^. Therefore, our main conclusion for the form factors of the hhh coupling shown 
in this paper can be applied to the momentum dependent coupling included in the above 
production processes in a good approximation. However, the large positive deviation in 
the hhh coupling does not necessarily imply the large deviation in the production cross 
sections by the same rate, because the rest of the gauge invariant set of Feynman diagrams 
usually do not contain the hhh vertex. There have been several studies for the correlation 
between the c hang e of the hhh coupling and the production cross sections at the LHcj^ 
and LC's0, 0, IsJ Fro^i the conclusions in those studies, we expect that the large non- 
decoupling effect in the hhh couplings in the THDM can be detected at future experiments 
at the LC's. 

We finally comment on the case of the MSSM. Since the Higgs sector of the MSSM is a 
special case of the Model II THDM with Ajf^ ~ (9(m^), as required by supersymmetry, it 



29 



belongs to the class of models in which the heavier Higgs bosons decouple. Hence, the effect 
of the Higgs boson loops to Thhh{MSSM) is expected to be small. A detailed study on this 
decoupling behavior of the one loop corrected hhh coupling in the MSSM can be found in 
Refs. Il2,ll3|l- We confirmed that our results for large values of M are consistent with those 



in Ref . 



VII. CONCLUSION 



We have discussed the one loop contributions of the heavy additional Higgs bosons to 
the hZZ and hhh couplings in the THDM. The form factors have been calculated in the 
on-shell scheme, and the deviation from the SM predictions are evaluated. 

The renormalized couplings of hZZ and hhh can deviate from the SM predictions due to 
two origins: the tree level mixing effect between the Higgs bosons and the quantum effect 
of the additional particles in the loop. We found that the deviations in the form factors can 
be large due to the non-decoupling effect of the heavy additional Higgs bosons when their 
masses are predominantly generated from the vacuum expectation value of the electroweak 
symmetry breaking; i.e., in a strongly-coupled THDM. In particular, the renormalized hhh 
coupling can largely deviate from the SM prediction due to the quartic power term of the 
masses of the heavy Higgs bosons, especially when the mass of the lightest Higgs boson h 
is relatively small. Even in the case where approximately only h couples to the weak gauge 
boson so that the mixing effect is small, the deviation in the hhh coupling from the SM value 
can be as large as a few 100%, while that in the hZZ coupling is at most a few times of — 1% 
or less. When the tree level mixing effect of the Higgs bosons is significant, the deviation 
in the hZZ coupling becomes significant by the factor of sin{(3 — a) while the large positive 
deviation in the hhh coupling due to quantum effect is smeared by the mixing effect. Such 
large quantum effect on the Higgs tri-linear coupling is distinguishable from the Born-level 
mixing effect, and can be detectable at a linear collider. 

In the weakly-coupled THDM, where the masses of the heavy Higgs bosons are predom- 
inantly generated from the soft breaking mass term M, the one loop effect is small and 
decouples in the large mass limit. 

We have shown how the non-decoupling effect of the additional heavy particles in the 
THDM can differ the Higgs boson couplings hZZ and hhh from the SM prediction. We 
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stress that the quartic mass effect on the effective hhh couphng is a general characteristic 
in any new physics model which has the non-decoupling property. 
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APPENDIX A: IN THE STANDARD MODEL 



Here, we show the calculation for the one loop contributions of the top quark to the 
form factors of hZZ and hhh vertices in the SM. The formulae for the leading top-loop 
contributions in Eqs. © and (jH)) are extracted from the results shown in IA 11 The appearance 
of the quartic mass dependence of the top quark in the hhh coupling in Eq. (jH} can also 
be shown through the effective potential method in IA21 Here, we consider only the third 
generation quarks (the top and bottom quarks) as the matter fields. 



1. Diagrammatic Method 



The Lagrangian of the SM is given by 



CsM = +QLD^YQL + tRD^-f''tR + bRD^YbR 

- {vbOl^bR + yt^QLtR + h.c.} + - VsM, 



(Al) 



where Q^^ = {t^^, 6^)"^, and D^^ is the covariant derivative. The Higgs potential is defined by 



..2|^|2 I \|^|4 



+ A|$| 



(A2) 



with the iso-doublet field $ being parameterized as 



^(f + h + iz), 



(A3) 



31 



where v (~ 246 GeV) is the vacuum expectation value, h is the Higgs boson, and and z 
are the would-be Nambu-Goldstone bosons. 

The kinematic term for the Higgs doublet field $ yields 

2 

i^Hzz = -fg^^z^z^K (A4) 

where we used the relation The tree level form factors of hZZ vertices are 



given by 



^hzz ^ ^hzz ^ j^hzz ^ ^ 



From the Higgs potential ()A2|) . we have 

VsM = -T,h + hml- ^)h' + "^h' + ^/^^ + (A6) 

where we introduced the parameters Th and m\ by 

n = v{^^-\v^), ml = 2\v\ (A7) 

and eliminated /i and A. The vacuum condition (the stationary condition) requires that 
the one-point function vanishes at the vacuum. At the tree level, this implies that Th = 0, 
so that the parameter rrih denotes the mass of h. The Higgs self-coupling interaction is 
expressed at tree level by 

ptree _ ^^fe ptree _ ^^fe { \S\ 

^ hhh ~ y ^ ^^'■^^>- ~ y2 ■ \-^°) 

The Yukawa interaction generates the mass of the quarks, and rrit = Ut^- Furthermore, the 
parameters of the Lagrangian g' , v, A, /x and yt can be replaced by m^, m^y, v, Th, m\ and 

The bare parameters of the model can be rewritten in terms of the renormalized param- 
eters as 

ml ^ ml + 5ml, {V = W, Z) (A9) 
V -> v + 5v, (AlO) 
Th ^ Th + 6Th, (All) 
ml ^ ml + 6ml (A12) 
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and the wave function renormalization factors are introduced with the renormahzed fields 

by 

^ ZlZ^ + C^^A^ = (^1 + + • • Z'^ + + ...) (A13) 

h ^ Zlh = ( 1 + \bZh + • • • ) /i- (A14) 



(5Mf^^ = — ^ ^ + + -bZh , 5Mf^ = (JMo^^^ = 0, (A16) 

V \ mi V 2 ' 



2 

From the kinematic term, we obtain the counter terms for the hZZ interaction, 

^--^C^f -T)v--<l-*-.-i^-*- 
We here neglect the effect of the Z-^ mixing, because it is of 0{a-^y^. Thus, we have the 
counter terms for the hZZ form factors as 

2m| / 5m\ 6v „ _ 1 

4 

The bare Higgs Lagrangian can be rewritten as 
>CHiggs ^ +^p^l + 6Z,,)h' 

- Xv^) (^1 + ^SZh^ + (5/^^ - SXv"^ - 2XvSv)} {v + Sv) h 
-IW - 3At;')(1 + SZh) + {Sf/ - SSXv'' - 6XvSv)}h^ 
-{Xv + 6Xv + X6v + ^Xv5Zh)h^ -^{X + 6X + 2X5Zh)h^ 

= £Higgs + Snh +l[ip'- ml)5Zf, - 5ml + V } 

5ml ml f 5v 3 ^ ^ \ "1 , o 
— - H h -5Zh > hr 

1 f 5m 



4 



where 5Th and 5ml consistently related to the shift of the Lagrangian parameters fi and 
A by 

5Th = {5fi^ - 5Xv^ - 2Xv5v)v = 5 {v{n^ - Xv^)} , (A18) 
5ml = 2(5A^;^ + AXv5v = 5 {2Xv^) . (A19) 
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The counter terms for the hhh and hhhh vertices are 



ir.., = -|2M + 5!i(-^^ + |*z.l^ (A20) 

I V V \ V 2 

ir,,,,^ -b-^+'-4(Jji + SZ,]}. (A21) 



y2 y2 y y 



Based on Eqs. ()A16|) and ()A20|) . we have to provide the counter term parameters Sm\, 
SZf^, 6v, 6m\, in order to calculate the one loop form factors of hZZ and hhh. In the 
following, we determine all these parameters by imposing proper renormalization conditions. 

The renormalization is performed in the on-shell scheme 27| . The counter terms of the 
gauge boson masses {6m^^, ^^%) and wave functions {5Z^r, SZ^) are obtained by calculating 
the transverse part 11^^ (p^) of the two-point function 

K^ip') = {-9,. + ^) nr(P^) + ^nr(p^), (A22) 

where VV = WW or ZZ. In the one-shell renormalization scheme, we obtain 



Qp2 

We define Sv by 

Sv 1 1 



Sml = Ren^^('^')(m|), (A23) 

(A24) 



6Z, = - #.Renf (^^^^(/^ 



V 2 



Ren^^*-^^^''(0) -|- (vertex and box corrections) , (A25) 



where the "(vertex and box corrections)" in Eq. ()A25|) is 0{a), and is neglected in our 
calculations. 

The other counter terms ST^, Sml and SZ^ are determined in the following way. Firstly, 
the tadpole must be zero after renormalization; i.e., at tree level we demand Th = f (/i^ — 
Xv^) = 0, and at one loop level, we impose 

rf = T^' + Tl^' + STh = 0, (A26) 

where is the renormalized tadpole and T^^^ is the one loop Feynman diagram of the 
tadpole (cf. Appendix lA 3|) . This determines the counter-term 6Th as 

5n = -Tl'''. (A27) 
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Secondly, we determine the rest of the counter terms in the on-mass shell scheme, i.e., 

Rer^Jm^] = 0, (A28) 



o 9 



where r^^[p^] is the renormalized two-point function of hh: 

r^.[/] = (p' - ml){l + 5Z^) -6ml+^-^ + n^fl/), (A30) 

and njj^^(p^) is the IPI Feynman diagram contribution (cf. Appendix IA3|) . Therefore, we 
obtain 

5ml = +ReUl^,\ml) - ^ReT,^^^ (A31) 



(A32) 



O 9 



Using the counter terms 5m 5Z^^ 5v, 6Th, 6m\, and 5Zh which are determined above 
with the IPI diagrams listed in Appendix lA 31 we obtain the renormalized form factors of 
hZZ and hhh. Consequently, the renormalized form factors are given by 

Mf^{plpl q^) = M^^^^'''''> + Mf^^'^'^ + 5M^^^, = 1 - 3) (A33) 

^ hhhiPii P21 (f) = ^t.hh ^ ^ hhhi (A34) 

where the momentum in Eq. ()A33jl is that of the external Higgs boson line. The leading 
contributions of the top quark mass in Eqs. (0) and (jH)) can be obtained from Eqs. ()A33|) and 
()A34|) by taking the large mt limit in the explicit expressions of each diagram contribution 
hsted in El 



2. Effective potential method 

The quartic power dependence of the top quark mass can be reproduced in the effective 
potential method. The effective potential provides the information of vertex functions with 
zero external momenta at each loop level. The one loop effective potential is given by 



tree I 



+ 



647r' 



f'^M'M [ In 



Ml 



(A35) 



where 99 = (0) = v + {h), N^j is the color number, Sf {Ng^) is the spin (degree of freedom) of 
the field / in the loop, M/[(y9] is the field dependent mass of /, and Q is an arbitrary scale. 
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The bare parameters /i^ and A in the SM Higgs potential Vgj^[(y9] in Eq. ()A2j) (= Krcciv^]) 
can be ehminated after introducing the one loop corrected vacuum expectation value v and 
the mass rrih in the following conditions: 

d 



dip 



lf>=V 



0, 



(A36) 
(A37) 



Let us consider the top-quark loop effect. Namely, in Eq. ()A35|) . f = t, Nc^ = 3, Ns^ = 2 
and the field dependent mass of t is given by 



Mt[ip] = yt 



(A38) 



The result of the renormalized coupling constant Tj^j^j^ is then obtained from 



^3 



ip=v 



37r^ v'^m\ ' ' 



(A39) 



where is the mass of the top quark. Because the top quark is a fermion, its loop effect 
on the effective potential is negative. 

Let us examine the origin of this quartic mass contribution. If we write ip = vo + h, then 
the effective potential is 

r / \ 2 

9 9/-. h \ 

Nc yf 



2 4 loTT^ 4 



In 



2Q^ 



Ir 



Nc yt 

167r2 2 



h 7h^ 13 
vo 2v^ 3 



(A40) 



where 



A = A 



N. 



167r^ 



y: In 



yX 3 



2Q2 



(A41) 



The first to third derivatives are calculated as 

dVeff _ 



dh 

'eff 



216772 



yt^o^ 



'eff 



7 N 
— /i + 3Afo 



2 167r2 



yt^o, 



6Afo — 13 — ^yfvr). 



(A42) 
(A43) 
(A44) 
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Using Eqs. (IX36|) and (|X37l) . we can eliminate /z^ and A by introducing the renormalized 
(at zero momentum) mass m^. Then, we obtain the renormahzed couphng Af^j^, as given 
in Eq. ()A39j) . The logarithmic term in the effective potential is completely eliminated by 
the mass renormalization. On the contrary, the higher dimensional operator terms in the 
effective potential generally survive even after the mass renormalization, which yield the 
0{mf) correction to the tree level hhh coupling. 



3. IPI diagram contributions in the SM 

We list the relevant one-particle irreducible (IPI) n-point functions for n = 1,2,3. The 
calculation is performed in Landau gauge, so that the Nambu-Goldstone bosons are massless 
(m^± = = 0). The SM Higgs boson coupling constants to be used below are defined as 
by 



a. One- and two-point functions 



The one loop top-bottom contributions and the Higgs scalar contributions to U^^lp"^) 
and n^'^(p^) are given by 



n|^(p2^ 



2 r 



[-/J - IfQfsl, + QJ4) {{D - 2)B22+p'{B, + B2i)} 



+ (If - QfSw)Qfs'^m'jBo {p'^,mf,mf) 

{c,^B,{p',m^,m^) + B,{p',m,,m,)} 



^^^(p2^ 



w 



Nc ml, 



{{D - 2)4^22 + V(5i + B21)} {p^; mt, m,) 
{B,{p';m^,m^)+B,{p';m^,m,)}, 



(A45) 



(A46) 



where we used the Passarino-Veltman functions |4a] for the tensor coefficients of the loop 
integrals, and we define i?5(p^; m^^, mg) = A{mi) -\- A{m2) — AB22{p'^', fn^, 1712) ■ If and Qf are 
the isospin quantum number and the electric charge of the fermion /. For example. If = 1/2 
and Qf = 2/3 for f = t. Also, sw = sin^vK; where 9w is the weak-mixing angle. The IPI 
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tadpole contributions are calculated as 



ipi 



f=t,b 



A{mf) 



167r2 



(A47) 



The IPI diagram contributions to the Higgs boson two-point function is obtained as 



f=t,b 



IGtt 



IQ^2 ^2 {4A(m^) + (-2p2 + 8mJ)So(p2;m^,my)} 

2 1 +(\a;c^)^-6o(P^;^a;,^a;) +2(A^^J^-Bo(p^;m^,m^) 



(A48) 



h. The hZZ form factors 



The IPI diagrams of the top-loop contribution to M^^^{p\,p\, q^) is calculated as 

^ 1 32Ncmjm% 



+2(D - 2)C24 + (3p? + piP2)Cn + (3piP2 + ^2)^12 + (Pi + PiP2)Co } 

PIC21 + P2C22 + 2P1P2C23 + -DC24 
+ + PiP2)Cii + {pip2 + P2)Ci2 + mjCo I (pi,P2, 5^; "^/, rnf, rrif) 



1 mi 



2 cos^ 2ewXhw+w-Bo{Q', m^±,m^±) + 2Xf^^^Bo{q; m„ mj 



+6A/,/,/,5o(g; m,^, m^) - 8 cos^ 2dwKu,+w-C2A{p\, pl,q'^; m^±, m^±,m^±] 
-^\zzC24{pI,pI, q^; m^, ruf^, mj - 24A^^;,C24(Pi,P2> ^fe) 



M^'^'iplplq' 



(A49) 



+ 
4 



1 32Ncm'imi rfl „ „ 9 . 1 f 1 
^ [{2^? - IfQf^w + I 4C23 + 3Ci2 + Cn + Co} 

{ifQfSw - Q}sw) I Cn - C12 }] ipl,pl, q^;mf, m/, m/) 

A 

- 8 cos^ 2^vfA;,^+^-Ci223(Pi,P2, m^±, "^»±, "^^±) 

- 24A^^;,Ci223(Pi, P2, TT^h, n^z, ^h) ] > (A50) 



1 m| 



-^\zzCi22z{p\,pI, g^; m^, m^, mj - 24A^^;, 



where C1223 = C12 + (^23, and 
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1 32Ncmjm% fl 



167r2 



IfQf^w^ { Ci2 - Cii - Co} {pl,pl,q'^;mf,mf,mf).{A51) 



c. The IPI hhh form factor 



The IPI top- loop contribution to the hhh couphng is calculated as 
1 SN^mj 



-Yl J 2"^ '3 ^ { 3 {piC2i + P2C22 + 2P1P2C23 + DC24) + (4p? + 2P1P2) Cii 
f=t,b L ^ ^ 

+ (2P2 + 4P1P2) Ci2 + (mj + + P1P2) Co}] {pI,pI, q^; mj, m/, m/) 

+2Aft^+^-A;,^^+^_ |Bo(g2;m^±,m^±) + Bo(p?;m^±,m^±) + Bo(p^;m^±,m^±) } 

-2AL+«,-Co(p?, P2> ^«;± > "^«,± > ^«;± ) 

-4^>izzCo{pl,pl, q'^;m^,m^, mj 

I Bo{q'^; m^, m^) + Bo{pl; rUf^, rUf^) + ^0(^2; ^/i, ^/i) } 
-108A^;,^Co(p^,p^,g^;m^,m^,m^)] . (A52) 



APPENDIX B: IN THE TWO HIGGS DOUBLET MODEL 



The kinetic and mass terms of the bare Higgs Lagrangian is written in terms of the 
renormalized quantities and the counter-term parameters as 



Higgs 



■^Higgs 

^5T,^h + 8ThH 



+--{{p - m^jSZh - + + \ h 

^ ' cosp V smfj V } 

2 cos^ a 6T1 sin^ a 6T2 1 2 
' H — : — ? H 



+^iip-mij)SZH-Smjj + 



cos P V sin j3 V 
+ { (2p^ -T^h- T^]i)^Ch - {m]j - ml)5a 



-\- cos a sin a 



1 5Ti ^ 1 8T2 



cos (3 V sin/? V 



Hh 



+ 1 [p^SZ, + cos/3^ + sin/3^ \ 

2 y V V 
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where 



+ I n - cosfJ 

cos p 



1 \ 6Ti fcos^(3 ^ 1 
— snap + 



cos (3 I 2v 



sin (3 



6To 



sin (3 I 2v 



A' 



+ <^ (2/ _ m^)5C^ + m\5l3 - sin /5— + cos (3— \ zA 

y V V ) 

( ST ST 1 

+ < p^SZ ± + COS P h sin P > w^w~ 

[ V V ) 

+ {{p^ - mjj±)SZjj± - Smjj± 

fsm^(3 ^ I \STi /cos2/3 . ^ 1 \ 1 ^ , 

+ - cos /5 H — - + ( ^ - sm /3 H — - } H^H 

\ cos (3 cos (3 J 2v \ sin p sin (3 J 2v \ 

+ I (2j92 - mjr±)SCH+ + m]r±S(3 - sin/?— + cos/5— 1 (w+i/^ + H+w-){Bl) 

y V V ) 



5T, 



cos aST^ — sin a^T^, 



(5T2 = sina(5r^ + cosa^T^j. 



(B2) 
(B3) 



1. One- and two-point functions 



The exphcit expressions for the relevant IPI diagrams are given in terms of the Passarino- 



Vehman functions 

thdmH. 

n|^(/) = - 



46l | below. The Yukawa couplings are assumed to be of the Model II 



16m| r 



-1} - IfQfsl, + QJ4) {{D - 2)B22+p'{B, + B21)} 



+ {If - Qfs'^)QfS^m'jBo {p'^,mf,mf) 

{c2wB.^{p'^,m^,m^) + B5{p^,m,,mh)} 



N, ml 



w 



i^B^ip^; m^, m,) + B^ip'^; m^, m^)} . 



{{D - 2)4^22 + Ap\Bi + B21)} {p^; mt, m^) 



(B4) 



(B5) 



ipi 



T 



ipi 

H 



Nc 4m? cos a , , , Ai'c 4m? sin a , , , 
* ;A{mt) + — ^ -A{mb) 



IGvr^ V cos /3 



IGtt^ f sin /3 

{Kh+h-Mtt^h±) + KaaM^a) + ^KhhM^h) + KHnMrnn)} , (B6) 



IGtt 
Nr 4m? sin a 



A{mt) 



Nc 'iml cos a , , , 
^ -^(mfe) 



IGvr^ t> cos/5 



IGvr^ f sin /3 

TTT^ {^HH+H-^{^H±) + + + 3A^^^y4(m^)} .(B7) 
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2 2 



t;^ sin /3 



2-2 

^rr^sma ^^^^^^^ ^ (-2^^ + 8m^)Bo(p'; m,,, m,,)} 
cos^p 

HKzzfBo{p^;m^,m^) - 2\hhAAA{mA) 

+18(A^^J'So(p'; m^, mj - 12AMh/.^(mJ - 2A^h,j^^A(m^)} , (B8) 



167r2 



2 • 

smacosa j^^^^^^, ^ ^_2p2 ^ 8m^)5o(p^; m*, m*)} 



sm a cos a 
1'^ sin^ P 
1 

167r2 



i'^ sin P 

{AA{mb) + (-2p2 + 8m^)5o(/;mfe,mb)} 



{+A 



+'^Kaa^haaBq{p^\ m^, m^) + KzA^HzABoip^] m^, m^) 
+'^Kzz^HzzBo{p^;rn^,rn^) - KHAAA{m^) 

+QKhh^hhhBo{p^; rriH, tuh) + A\hHKHHBo{j>'^] m^, tuh) 

+^\hh\hHBo{p'^; m^, rufj - 3XhhhHA{m,^) - 3XhHHHA{mH)} ■ (B9) 



^Tip') 



167r2 



+^ tan/3 {4A(mb) - 2p^Bo{p'^; rrib, rrn,)} 



cot P {4A{mt) - 2p^Bo{p^;mt,mt)} 



{-Kah+h-AC^h^) 



167r2 



+'2^hzA^haaBo{p'^; m^, tuh) + 2Xf^^^Xf^^^Bo{p'^; m^, m^) - SX^aaaM'^a) 

+^^Hzz^HzaBo{p'^; m^, ttih) + 2X,^^^X,^^aBq{p^; m^, m,^) 

-XHHzAA{mjj) - XhhzAA{mf^)} . (BIO) 
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a. The Z-A mixing 



The expression of the form factor T^^ of the Z-A mixing is given as 

1 



ZA 



167r2 
rriy 



TTlr 



rrir. 



TTlr 



sin(a - P)Xh^^{2Bi + fio)(p^; m^j, m^) 
sin(a -/5)A^^^(2fii + Bo){p'^;mh,m^) 
cos(a - P)\h^j^{2Bi + Bo){p^;mH,m^) 



(Bll) 



where Iq is the iso-spin of the quark g, c^^^ = ~ ^^"^ ~ Model 

II THDM, and the Higgs self-couphngs Xf^j^^ ^haa \zA ^"^^ '^HzA hsted in Appendix lEl 



The hZZ vertex 



The exphcit expressions for the IPI diagrams of the form factors of the hZZ vertex are 
j;iven in terms of the Passarino-Veltman functions [40] by 



Mnplplq') = 
1 ?,2N^m)m\ 



l^j) - IfQfsl, + gj^l I 2plC21 + 2plC22 + 4piP2C23 



+2{D - 2)C24 + {3pl + PiP2)Cn + {3piP2 + ^2)^12 + {pI + PiP2)Co } 

+ {ifQfslr - Q}stv) { pIC2i + PIC22 + 2P1P2C23 + DC2^ 

+ {p\ + PiP2)C II + {pip2+pl)C 12 + m)Co \ {pl,pl,q'^]mf,mf,mf) 



X TTh^ r 

+ 2 2 2cos^2^,4/A^^+^_Eo(g;m^±,mj^±) 
+2 cos^ 2^H-A^^+^_5o(g; m^±, m^±) 

-8 cos^ 29^X,^,^^C2M,pI m^^,m^^,m^^) 

-8 cos^ 2e^x,^,^.C2,{plpl g'; 

-8 sin2(a - /3) | A^^^C24(p2, p^, g^; m^, m^,, mj + A;,^^C24(p?, pl,q^;m^,mH,m^) 
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+KhhC24{pI,pI, g^; rriH, rriA, m^) + 3A^;,/,C24(p2, g2. ^^^^ | 

-8 cos^(a - /3) I A;,^^C24(p^,p2^ g^; m^, m^, m^) + A;,^^C24(p^,p2^ g^. 
+^h/fHC24(p?,pL "^iT, "^h) + 3A^;,;,C24(p?,P2. g^; m^, m^, m^) I 
+4 cos(a - /3) sm(a - /3) | A;,^^C24(p2, g^. ^ A^^^C24(p?, P2> g^; m^, m^,, 

-^/.^aC24(p?,P2> g^; m^, mj;^, m^) - \hzAC2A{pl,pl, q'^;m^,mH,m^) 
+'^KhHC24{pl,pl, q^;mf^,m^,mjj) + 2\^hC24{pI,pI, q^^m^, 
-^\hHC24{pl,pl,q'^;mf^,m^,mH) - '^KhHC2A{pl, pI, q' 



(B12) 



M,'''{pl,pl,q') = 
1 ?,2Njn)m% 



A 



- //Q/s^, + Qjs'w^ { 4C23 + 3Ci2 + Cn + Co] 



■,mf,mf,mf) 



1 m 

^2 



- 8 cos^ 29^\^,^^C^223{plpl m^,,m^,,m^,) 



-8 cos^ '20w\yj+^~Ci223{pl,pl, q^; m^±,m^±,m^±) 
-8sin2(a - /3) | A^^^Ci223(p?,P2' (I'^'i^z^^h^^z) + KaaCi223{pI,pI, q'^;m^,mH, m^) 
+KHHCi223{pl,piq^]mf^,m^,mjj) + 3\f^^Ci223{pl,pl,q^-,mf^,m^,mf;) | 

-8cOS^(a-/?) I A;,^^Ci223(p?,P25g^;"^A)"^h5"^A) + ^/.^^C'l223(P?,P2>g^"^2)"^J/)"^J 

+\/fHCi223(p?,pL g^; m^, m^, mjj) + 3A;,/,^Ci223(p?,pi "^ft, "^/.) } 

+4cos(a-/3) sm(a-/3) | A;,^^Ci223(p?,pi g^; J^^, "^a) + -^/i^ACi223(p?,pi g^; ?^a, "^J 

-KzaCi223{p\^pI^ g^ "^iT, "^a) - KzaCi223{pI^ pI, g^ "^A5 ^z) 

+'^KhHCi22-i{pi, pI, g^; rrif^, m^, m^) + 2A;,;,^(:7i223(p?, P2, g^; "^/i) 

-2A;,;,J^C'l223(Pl,P2.g^;"^/^."^A."^H) - 2Aft,;,j:^Ci223(P^P2.g^;'^^ } . (B13) 



M3''^^(j>?,j>Lg^) = 

1 32Ncm)m% 
( 



(^^/ ~ ^fQf^w^ { '^la - <^ii - Co] {pl,pl,q'^;mf,mf,mf), 



(B14) 



where Chtt = cos a/ sm/3 and C/j^g = — sin a/ cos/3 in the Model II THDM, and the each 
coupling constant of Higgs bosons is listed in Appendix El 
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3. The IPI hhh form factor 



The explicit expression for the IPI diagrams of the hhh form factor is given in terms of 
the Passarino-Veltman functions 46| by 



1 



-E 

f=t,b 



167r2 



^hff 



3 (p?C2i + pIC22 + 2P1P2C23 + DC2a) + (4p? + 2P1P2) Cn 



+ (2P2 + 4piP2) C12 + (mj +pI + P1P2) Co}] {pj,pl, g^; m/, m/, m/) 
'^Kn+H-KhH+H- {Bo{q^-mjj±,mjj±) + BQ{p\-mH±,mH±) 



167r2 



+4A?,^+j^-A^^^+^„ I Bo{q^-m^±,mH±) + BQ{pl-m^±,mH±) + BQ{pl-m^±,mH±) } 



,3 lJ2 J2 „2 



A. I 5o(g^;m^±,m^±) + 5o(p?;m^±,m^±) + So(p2;"^^±,"^^±) } 
~'^KH+H-Co{pi,piq'^;rnH±,mH±,mH±) 

+Co{pl,pl,q'^;mj^±,m^±, ) + Co{pl,pl,q^;m^±,mH±, m^± ) | 
-2A;,^+^-A^^+^- I Co{pl,pl,q^;mjj±,m^±,m^±) 
+Co{pI,pI, q^] m^±,mjj±,m^±) + Co{p\,pl, g^; m^±,m^±, mH±) | 
-2A^^+^-Co(pi,P2, "^«,±, "^«,±, "^«,±) 

+4A?,aaAmaa { Bo{q^] m^, m^) + Boipj; m^, m^) + Bo{pl; m^, m^] 
+'^\zA\hzA { Boiq^] m,, m^) + Bo{p\- m^, m^) + Bq{pI- m^, m^) 
+^\zz\hzz { Bo{q^\ m^, mj + Bo{pl- m,, mj + Bo{pl- m^, mj } 

-^ALa'^oIP?, P2> q^'^T^A^^A^T^Al 
-'^KaA^IzA { C'o(P?, "^A, "^A, "^J 

+Co{pl,pl,q'^;mj^,m^,mj^) + Co{pl,pl,q^;m„mA,mA) | 

-2A;,^^ALa { C'oIp?, 9^; "^a, "^2, "^J 
+Co{pl,pl,q'^;m^,m^,m^) + Co{pl,pl,q'^;m„m^,m^) | 

-4ALCo(p?, 9^; "^2, "^2, "^J 
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-108A^h/iC'o(p?,pi g^; "^h, "^h) 

-'^^Khh>^hhH { C'o(p?, g^; "^H, "^h, ^h) 

+Co{pI,pI, ct\ "^ft, "^iT, "^/,) + <^o(P?, P2> g^ "^ft) ^h) 

-^KnH^hhH { Co{pI, pI, q^; rrij^, m^, nijj) 
+Co{pI,pI, m^, m^^, + Cq{p\,p\, m^, m^, m^^) 
-4:^hHHCo{pl,pl,q^;mjj,mjj,mfj)] , (B15) 

where Chtt = cos a/ sin/5 and C/j^g = — sin a/ cos/? in the Model II THDM, and the each 
coupling constant of Higgs bosons is listed in Appendix lEl 



APPENDIX C: WAVE FUNCTION RENORMALIZATION 



Let us consider the wave functions of h and H. The bare scalars satisfy 



hiB 




COS 


— sin 




Hb 


h2B 




sin 


cosa^ 







B) 



We can write 



B 



R{—ai 



hiB 

h2B 



R{-6a)R{-a)Z 

where Z is a arbitrary real symmetric matrix, so that 

Z = R{-a)ZR{a) 



R{-5a)R{-a) 
= R{-6a)Z 



h2 



Hb 
hs 

hiB 

h2B 

H 
h 



yl/2 yl/2 

^hH ^hh 



is also arbitrary symmetric {Z^h = Zuh)- We may expand these elements by 



'hh 



1 + 5Z 



H 



1 + 5^. + - 

+ + ■ 



In this way, we obtain Eq. (jinj. 



(CI) 



(C2) 



(C3) 

(C4) 
(C5) 
(C6) 
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APPENDIX D: PERTURB ATIVE UNITARITY 



The condition of perturbative unitarity has originally been discussed for the elastic scat- 
tering of the longitudinally polarized gauge bosons and the Higgs boson by Lee, Quigg and 



Thacker 



33l |. The channels W^Wj^ , Z^^Z^^, Z^h, hh are considered as the initial and final 



states, and the condition in Eq. ()101|) with ^ = 1 is imposed to each eigenvalue of the 4x4 
S-matrix. 

The extension to the THDM has been studied by several authors Is^-lssj]. The 14 channels, 
W^W£, W^H-, H+W^,H+H-, Z^Zl, Z^A, AA, Z^h, Zj^H, Ah, AH, hh, hH, HH, (Dl) 



471 145 [Jias been employed to 
|. The 14 eigenvalues 



have been taken into account, and the equivalence theorem 
evaluate the tree level S-wave amplitudes for each channel in Ref. 
of the S-matrix are calculated and their expressions are given in terms of the Higgs coupling 
constants by 

1 



_i_a(A. + A.)±Ji(A,-A,)= + A: 



4 r ' 



ei 

62 

/+ 
/- 
/l 



"it " 

1 

IGvr 
1 

IGvr 
1 

16^ 
1 

IGvr 

/2 = 



^U(A, + A.)±Ji(A,-A.p + A 



5 r ' 



(A3 + 2A4 - 3A 



5J , 



(A3 -A 



5) , 



(A3 + 2A4 + 3A5) 

(A3 + As) , 

^ (A3 + A4). 



IGtt 



The perturbative unitarity condition is then expressed by 

|a±|, \b±\, \c±\, \d±\, |ei 2I, |/±|, l/iol < ^• 



(D2) 
(D3) 

(D4) 

(D5) 
(D6) 
(D7) 
(D8) 
(D9) 

(DIO) 



The condition in ()D10|) with the tree level mass formulas in Eqs. (j^Bj) to ()30|) constrains the 
parameter space of the Higgs sector. The parameter ^ is taken to be 1/2 in our numerical 
evaluation I21I. 
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APPENDIX E: HIGGS COUPLINGS IN THE THDM 

Here, we list the Higgs boson self-coupling constants in the THDM, which are expressed 
in terms of our input parameters. 



1. Trilinear Higgs couplings 



^hhh 

^hHH 
^Hhh 
^HHH 

^hAA 

^HAA 

^hzz 
^Hzz 
^hzA 
^HzA 
^hH+H- 



1 



X 



Av sin 2(5 

sm.{a — (3) 
2v sin 2/5 
cos(a — P) 



cos(3q; — P) + 3 cos{a + (3) 

-4cos^(q; - (5) cos{a + /JjM^ 
sin 2a{ml + 2m]j) - (3 sin 2a + sin 2I3)M^\ , 



sin 2a{2ml + m]j) - (3 sin 2a - sin 2(5)M^\ , 



2vsin 2/3 

: — — - \i sin(3Q; — (5) — 2> sm.{a + (5) \m\ 
in L V. J 

+4sin^(a - p) sin (a + 13)1^^ 
'^1 cos(q; — 3/3) + 3 cos(q; + /?) 
-4 sin 2j3 sin(a - I3)m\ - 4 cos(q; + /3)M^ 
I sin(ci; — 3/3) + 3 sin(Q; + (3) 
+4 sin 2/3 cos(a - I3)m\ - 4 sin(Q! + /3)M^ 



Av sin 2/3 



Av sin 2/3 



Av sin 2/3 



m 



2v 



-sin(Q; - /3), 



m 



— cos{a — (3), 



2v 

m\-ml 



cos{a — /3), 



— m 



— s\n{a — /3), 



1 



2T;sin 2/3 



1 



HH+H- — 



2vs\n 2/3 



I cos(q; — 3/3) + 3 cos(q; + (3) 

-4 sin 2/3 sin(a - /3)m^± - 4 cos(a + I3)M'^ 

I sin(Q; — 3/3) + 3 sin(Q; + /3) 



(El) 

(E2) 

(E3) 

(E4) 

(E5) 

(E6) 
(E7) 
(E8) 
(E9) 
(ElO) 

(Ell) 
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+4 sin 2/3 cos(q; - /3)mjj± - 4 sm{a + /3)M^j , 



m 



Kw+w- = — sm{a-(3), 

V 

>^Hw+w- = -cos{a-p), 

V 

mi± - ml . ^. 
Kw+H- = — cos(q;-/3), 

V 
V 



2. Quartic couplings 



A 



hhhh 



A 



hhhH — 



A, 



hhHH 



A 



zAAA 



A 



hhAA — 



A 



hhzz 



1 



32^2 sin^ 2/? 



I cos(3q; — P) + 3 cos{a + /3) | 

+4 sin^ 2a cos^(a - /3)m| - 4(cos 2a + cos 2pfM^ 
sin 2a cos(a — (3) 



1 



16^2 sin^ 2p 



sin2 2/? [{ - + 3 cos(a + /3) 

+2 sin 2a sin(a - /9)m^ - 4 cos(a + (3)M^ 
sin 2a|6 sin 2a + 3 sin(4a — 2/3) — sin 2/3|m^ 

+ sin 2a|6 sin 2a — 3 sin(4a — 2/3) + sin 2/3|m^ 
-2(2-3 cos 4a + cos 4/3)M2j , 

— -[l3cos2a + cos(2a-4/3) +4cos2/3lm? 

8f2sin2/3Ll ^ ^ ^-j ft 

- 13 cos 2a + cos(2a - 4/3) - 4 cos 2/3|m^ - 8 cos 2/3M^ 

— [(g + 3 cos 4a + 6 cos(2a - 2/3) 

32^;2 sin^ 2/3 L I ^ 

+ cos(4a - 4/3) + 3 cos 4/3 + 10 cos(2a + 2/3) 

+2 sin 2/3|3 sin 2a + sin(2a - 4/3) + 2 sin 2/3|m| 

+16 sin^ 2/3sin2(a - (5)m\ 

+2|6 + cos(2a - 6/3) + 2 cos(2a - 2/3) 

+2 cos 4/3 + 5 cos(2a + 2/3) jM^] , 

|2 sin 2a + sin(4a - 2/3) - 3 sin 2/3) 



16^2 sin 2/3 
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A 



hhzA 



-4 sin2acos^(a - P)mjj - 8 sin2/5cos^(a - (3){m\ - 

cos(a; — [3) 
4f2 sin 2/? 



(E22) 



^HHzA 



^hhH+H- 



cos(3a; — /3) + 3 cos(q; + /5) + 2 sin 2a sin(a — (3)m^^ 
+4 sin 2/? sin(a — cos(q; — /5)M^ , (E23) 

2 sin 2a cos(a — I3)m\ — | sin(3a — /3) — 3 sin(a + /5) 



sin(a — /5) 
' 4i;2 sin 2/3 

-4 sin 2j3 cos(a - /5)m^ - 4 cos 2/3 sin(a - /3)M^ , 

-^-^ — [(9 + 3 cos 4a + 6 cos(2a - 2j3) 

l&v^ sin 2/3 L I 

+ cos(4a -4/3) + 3 cos4/3 + 10 cos(2a + 2/3)|m^ 
+ |3 - 3 cos 4a + 2 cos(2a - 2(3) 

- cos(4a - 4/3) + cos 4/3-2 cos(2a + 2/3) 
+16 sin2(a - /3) sin^ 2/3m^± 
-2|6 + cos(2a - 6/3) + 2 cos(2a - 2(3) 



(E24) 



1 



^hhw+H- 



X 



hHH+H- 



8^2 sin 2(3 

cos(a — /?) 
4f2 sin 2/3 

1 

~4t;2 sin^ 2/3 



+2cos4/3 + 5cos(2a + 2/3)}M2 , (E25) 
|2sin2a + sin(4a — 2/?) — 3sin2/3|m^ — 4sin2acos^(a — (3)m\j 



-8 sin 2(3 cos^ (a - (3) {m]j± - 



(E26) 



cos(3a — /3) + 3 cos(a + (3) \m\ + 2 sin 2a sin(a — (3)m\ 



+4 sin 2(3 sin(a - /3)m^± - 4 cos 2/3 cos(a - /3)M^ 

sin2a|3cos2a + cos(2a — 4/3) + 4cos2/3|m^ 

+ sin2a| — 3 cos 2a — cos(2a — 4/?) + 4 cos2/3|m^ 
—4 sin 2/3 sin(2a - 2/3)m^± 
-4(2 sin 2a cos^ 2/3 + sin^ 2/3 sin (2a + 2(3)] M'^ 



(E27) 



(E28) 



^zAH+H- 



4i;2 sin 2/3 



-fl3cos2a + cos(2a-4/3) +4cos2/3lm 

5in 2/3 L I J 



- <^ 3 cos 2a + cos(2a - 4/3) - 4 cos 2/3 - 8 cos 2(3M'^ . (E29) 
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